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ABSTRACT 


A  numerical  technique  for  calculating  the  optimal  control  for  a  class  of 
systems  and  constraints  is  described.  Nonlinear,  time-varying  deterministic 
systems  subject  to  hard  state  space  and  hard  control  space  constraints  are  con¬ 
sidered.  Three  numerical  procedures  are  developed  to  perform  the  optimization. 

A  technique  for  the  minimization  of  a  scalar  function  of  a  vector  variable  is 
described  where  the  components  of  the  vector  are  constrained  by  upper  and  lower 
bounds .  This  minimization  procedure  is  incorporated  in  a  method  of  constraint 
mapping  which  maps  the  state  space  constraints  into  the  control  space.  To 
improve  convergence  properties  of  the  optimization  procedure  the  notion  of  a 
pseudo  performance  index  is  introduced.  Initial  and  final  states  may  be  partial¬ 
ly  or  completely  specified.  Any  unspecified  initial  or  final  state  vector 
components  are  optimally  selected. 

An  iterative  technique  for  the  optimization  is  demonstrated  which  ).  • 
generally  converges  to  a  local  minimum  of  the  performance  index.  The  method 
uses  the  direct  approach  to  optimization  and  is  very  efficient  computationally. 
Examples  of  space  vehicle  trajectory  optimization  problems  are  given. 
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1.  PERSPECTIVE  -  I 

1.1  Recent  Trends  in  Modern.  System  Theory 

For  the  purpose  of  this  work,  we  will  consider  that  modern  system  theory 
has  evolved  from  the  1950's  when  the  state  variable  formulation  of  control 
problems  was  introduced  and  studied  by  Bellman1 .  Of  course  .we  recognize  that 
the  state  variable  formalism  is  not  new;  only  its  application  to  control  problems 

is  recent.  This  is  a  convenient,  if  somewhat  artificial,  beginning. 

2,3 

As  noted  elsewhere  3  the  use  of  the  modern  theory  enables  the  designer 
to  consider  his  problem  in  the  time  domain  with  the  physical  time  domain  con¬ 
straints  as  an  integral  part  of  the  problem  formulation.  The  so-called  "cut- 
and— try"  techniques  of  the  classical  control  theory  are  no  longer  necessary. 
However,  a  certain  new  type  of  'cut-and-try';  design  is  introduced.  This  new 
scheme  is  systematized  to  the  extent  that  algorithms  are  created  which  assure 
that  each  succeeding  try  is  better  than  the  previous  one,  a  process  ,hich  we 
call  monotone  iteration.  The  most  significant  property  of  monotone  iter.at.lve: 
procedures  is  that  by  using  them  we  are  always  assured  of  doing  better  if  we 
persist.  That  is,  if  n  iterations  have  produced  a  certain  result,  then  the 
(n  +  l)st  iteration  will  produce  a  "better"  result.  The  method  of  solution  to 
be  described  in  Chapter  3  is  an  example  of  such  monotone  iteration. 

The  term  ,Jbetter"  is  given  a  precise  meaning  by  the  introduction  of  a 
mathematical  performance  index.  This  is  a  functional  which  represents  how  well 
the  system  is  doing.  Generally  we  ask  for  this  functional  to  be  taken  to  an 
extreme  value.  Without  loss  of  generality,  we  will  henceforth  assume  that  it 
is  to  be  minimized.  Now,  in  many  systems  an  appropriate  input  (a  time  function) 
can  be  generated  which  will  drive  the  system  through  its  state  space  (in  time) 
in  such  a  manner  that  the  performance  index  is  indeed  minimized .  However,  in 
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many  systems,  such  control  (i.e.,  such  an  input)  would  also  lead  to  gross  mis¬ 
behavior  of  the  system.  This  may  arise  from  saturation  nonlinearities,  oscil¬ 
latory  modes  of  operation,  excessive  fuel  requirements,  excessive  aerodynamic 
pressures,  velocity,  etc.  It  is  for  such  reasons  that  many  physically  meaning¬ 
ful  problems  involve  constraints  on  the  state  of  the  system  and  the  inputs  to 
the  system.  We  say  that,  in  order  to  avoid  certain  undesirable  behavior  of  the 
system,  state  space  constraints  and  control  space  constraints  are  imposed. 

The  evolution  of  modern  system  theory  has  passed  through  many  different 
phases  of  development  during  which  time  a  variety  of  systems  and  constraints  • 
have  been  considered.  It  is  hardly  necessary  here  to  discuss  these  systems 
and  constraints  which  have  been  considered  in  the  past.  It  is  sufficient  to 
point  out  that  the  work  described  in  these  pages  is  the  subject  of  a  large 
amount  of  current  effort  by  system  theorists  and  mathematicians. 

The  work  described  in  these  pages  is  an  engineering  solution  to  the  opti¬ 
mal  control  problem  for  totally  constrained  (i.e.,  state  and  control  space 
hard  constraints)  invertible  systems..  The  constraints  considered  are  practical 
ones  1  The  method  of  solution  is  computationally  feasible  and  completely  auto¬ 
matic  in  that,  no  decisions  by  the  computer  operator  are  required  during  the 
course  of  the  computation. 

Section  1.2  contrasts  this  method  of  solution  with  others  recently  pro¬ 
posed  .  ■  . 

1.2  State  Space  Constraints 

In  the  evolution  of  modern  system  theory  mentioned  above  the  first  con¬ 
straints  to  be  considered  were  control  space  constraints.  These  typically  re¬ 
quired  the  control  vector  to  be  contained  in  a  closed  region  of  the  control 
space.  Until  1959  there  was  no  mention  of  state  space  constraints.  This  was 
probably  true  for  two  reasons.  The  control  space  constraints  provided  suffi- 
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ciently  complicated  analytical  difficulties  by  themselves  and  also,  there  were 

not  sufficient  results  published  to  attract  attention  to  certain  analytical  re- 

suits  which  proved  to  be  physically  unrealizable.  In  1959,  a  fundamental  paper 
* 

by  Gamkrelidze  considered  the  problem  of  state  variable  constraints  in  some 
detail.  His  paper  delineates  a  set  of  necessary  conditions  which  a  system 
trajectory  and  control  must  satisfy  in  order  to  be  optimal  when  the  state  of 
the  system  is  restricted  to  lie  in  a  closed . region  and  the  control  is  also  re¬ 
stricted  to  lie  in  a  closed  region.  It  is  shown  that  those  portions  of  the 
optimal  trajectory  which  fall  entirely  within  the  closed  region  in  the  state 
space  must  satisfy  the  maximum  principle.  A  necessary  condition  is  also  proven 
for  the  portions  of  the  trajectory  which  lie  entirely  on  the  boundary  of  the 
closed  region  in  the  state  space.  Further,  a  jump  condition  is  defined  which 
is  necessarily  satisfied  by  every  pair  of  adjoining  sections  of  an  optimal  tra¬ 
jectory,  one  of  which  lies  in  the  interior  and  the  other  on  the  boundary  of 
this  closed  region.  These  results  give  certain  analytical  properties  of  opti¬ 
mal  trajectories  but  do  not  seem  to  yield  easily  to  computational  solution  of 

26 

optimal  programming  problems  .  Berkovitz  obtained  the  same  results  using  the 

calculus  of  variations . 

'5 

■  In  1961,  Chang  determined  a  simpler  set  of  necessary  conditions  for  the 
special  case  of  fixed  time  optimal  control  with  free  end  point .  Moreover,  he 
showed  that  for  linear  systems,  if  the  restricted  regions  in  the  state. space 
and  in  the  control  space  are  convex,  the  condition  stated  is  also  sufficient. 
This  condition  also  holds  for  minimal  time  control  between  two  fixed  points. 
Again,  the  main  emphasis  in  Chang's  paper  is  to  derive  necessary  (and  sometimes 
sufficient)  conditions  with  little  regard  for  computational  feasibility. 

4 

^Recently  rewritten 
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Some  consideration  of  the  computational  aspects  of  optimal  programming 
problems  was  given  in  Breakwell's6  paper  in  1959.  However,  in  1961,  several 
papers  appeared  which  seriously  considered  the  computational  aspects  of  the 

optimization  problem.  Some  of  these  did  not  consider  any  state  space  or  control 

7  8  9 

space  constraints  1  ;  some  considered  only  control  space  constraints  ;  some 

10 

considered  only  state  space  constraints  ;  and  some  considered  both  state  and 

11  12 
control  space  constraints  .  In  July  1962,  Dreyfus  published  a  paper  which 

summarized  his  earlier  work  and  gave  some  numerical  results  and  discussion  of 
a  computational  technique  for  the  totally  constrained  problem.  He  was  inter¬ 
ested  in  a  single,  time  independent  constraint  on  the  state  variables  and  a 
scalar  control  variable  of  a  more  general  type  than  Gamkrelidze  considered. 
Dreyfus  derives  the  computational  procedure  through  use  of  a  dynamic  program¬ 
ming  formulation  of  the  problem.  In  this  way  he  obtains  expressions  for  incre¬ 
mental  improvements  in  the  control  program  at  each  step  in  the  iteration. 

Another  scheme  which  has  gained  wide  acceptance  falls  in  the  general 
category  of  gradient  .techniques  .  Kelly^;  1  ;  ^  was  an  early  advocate  of  gradient 
methods  applied  to  optimal  programming  problems .. 

The  two  most  significant  results  dealing  with  the  topic  of  the  present 

work  are  due  to  Ho  and  Brentani15  and  Denham  and  Bryson16  both  of  which  appear- 
’  15 

ed  in  November  1962.  In  the  paper  by  Ho  and  Brentani  ,■  fixed  time  problems 
are  considered  with  hard  inequality  constraints  either  in  the  state  space  or 
the  control  space.  They  note  that  considerable  difficulty  is  encountered  for 
non-linear  systems  using  their  method.  Also,  the  restriction  to  either  state 
or  control  space  constraints  is  a  significant  one.  On  the  other  hand,  Denham 
and  Bryson16,  considered  general  state  and  control  space  constraints  with  a 
single  inequality  constraint  and  a  scalar  control  variable.  Their  method  is 
essentially  one  of  steepest  descent.  A  striking  disadvantage  of  their  approach 
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is  that  complicated  on-line  calculations  and  decisions  by  the  researcher  are 

17 

required  during  computation  .  They  consider  free  end  points  and  free  final 

time  problems  as  well  as  those  mentioned  above. 

It  is  well  to  note  exactly  the  class  of  problems  being  solved  in  the  present 

work  in  order  to  place  it  among  the  efforts  mentioned  above.  Here  w'e  consider 

non-linear,  time-varying,  deterministic  systems  which  are  invertible  (to  be 

defined  later) .  The  constraints  are  simultaneously  imposed  in  the  state  and 

control  spaces  and  are  hard  inequality  constraints  .  The  performance  index  is  a 

general  function  of  the  state  and  the  control  over  a  prescribed  time  interval. 

In  general,  both  the  state  and  control  variables  will  be  vectors .  The  technique 

to  be  described  is  a  gradient-type  method  based  on  two  principles  .  First,  a 

mapping  is  defined  which  collects  all  state  and  control  space  constraints  into 
*  1  ■  18 

the  control  space  .  Secondly,  a  minimization  technique  is  used  to  successively 
select  controls  which  reduce  the  performance  inde.  ,  . 

It  would  appear  that  this  method  and  that  of  Denham  and  Bryson  are  competi¬ 
tive  and  should,  in  the  future,  be  carefully  compared.  The  method  of  this  work- 
is  direct  ,  whereas  most  of  the  other  authors  have  concentrated  on  indirect 
techniques „  In  the  opinion  of  the  author,  there  has  not  been  conclusive  evi¬ 
dence  that  one  scheme  is  better  than  the  other  for  all  problems.  Even  so,  only 
little  work  has  been  done  on  direct  methods  of  solution.  It  SeentS'  that,  at 

this  stage  of  .technology,  we  cannot  exclude  either  approach. 

28 

A  recent  publication  of  Friedland  gives  some  evidence  that  several  compu¬ 
tational  techniques  for  nonlinear  programming  are  currently  being  compared  in  a 

unified  study.  It  is  felt  that  work  such  as  this  is  necessary  to  effectively 
use  appropriate  techniques  for  specific  problems  . 

3 

*This  is  a  generalization  of  a  result  published  earlier  by  the  author  . 

**A  direct  method,  depends  on  successive  comparisons  of  a  function.  An  indirect 
method  seeks  a  minimum  by  means  of  a  necessary  condition  for  the  minimum14.  r 
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2.  THE  PROBLEM 

In  what  follows,  capital  Roman  letters  will  denote  matrices  whose  dimensions 
will  be  obvious  from  the  text.  Small  underlined  Roman  letters  will  denote 
vectors.  Again,  dimensions  will  be  obvious.  Any  deviations  from  this  notation 
will  be  clearly  indicated  in  the  text. 

An  expression  involving  functions  and  functionals  will  be  accompanied  by  a 
statement  indicating  its  domain  of  definition.  For  example: 

x(t)  =  f[x(t)  ];  t£  (0, T  ]  (2.0.1) 

is  an  equation  relating  a  vector  function  x(t)  and  a  veqtor  functional  £  defined 
on  x(t)  for  t  £  (0,T  ]  where  (  and  ]  have  their  usual  meanings.  The  equation 

x(t)=f[x(t)]  (2.0.2) 

is  an  expression  involving  vectors  of  numbers.  For  the  discrete  case,  a  similar 
distinction  is  made 

x(k  +  A)  =  f[x(k),  u(k),  A];  k  =  1,  2,  ...,K  ,  (2.0.3) 

.and 

x(k  .+  A)  =  fjx(k),  u(k),  A]  (2.0.4) 

Only  stationary  systems  will  be  considered  since  time  varying  systems  of 
equations  can  be  written  as  stationary  ones  by  introduction  of  another  state 


variable  ,  . 
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2.1  Definition  of  Invertible  Systems 

If 


x(t)  =  f[x(t),  u(t)  J;  t  £[0,T] 


(2.1.1') 


we  say  that  (2.1.1*)  is  invertible  if  there  exists  a  single  valued  vector 
function  g_  such  that 

u(t)  =  ig[x(t),  x(t)];  t£[0,T]  (2.1.2') 

Since  we  are  dealing  with  a  problem  of  numerical  solution  of  optimization 
problems,  we  immediately  turn  our  attention  to  the  discrete  version  of  (2.1.1*) 
and  (2.1.2'),  namely 


x(k  +  A)  =  f[x(k),  u(k).  A];  k  =  1,  2,  ...,  K 


(2.1.1) 


and 


u(k)  =  g[x(k  +  A),  x(k) ,  A];  k  =  1,  2, 


K 

) 


(2.1.2) 


Two  general  classes  of  invertible  systems  may  be  defined  as  follows. 
1.  Class  a  invertible  systems. 

This  class  is  made  up  of  two  subclasses: 
a)  Class  (linear  control)  invertible  systems: 


x(k  +  A)  =  f[x(k),  A]  +  B[x(k),  A]  u(k) ;  k  =  1,  2, 


•  •  • , 


K  . 


(2.1.3) 
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where,  x  is  an  n-vector  and  u  is  an  m-vector,  B  is  an  n  x  m  matrix  with  the  typi 
cal  element 


bii  *  bij[x(k),  Al;  k  f  1,  2,  . ..,  K 


(2.1.4) 


Moreover,  it  is  required  that  the  matrix  B  have  rank  m.  This  requirement  is 
necessary  to  insure  the  independence  of  the  control  variables . 

b)  Class  a  (non-linear,  diagonal  control)  invertible  systems: 

x(k  +  A)  =  f[x(k),  A]  +  B[x(k),  A]  H[u(k)  ];  k  =  1,  2,  . . .,  K  (2.1.5) 


where  B  is  as  described  for  class  invertible  systems  and  H  is  an  m  x  m 
diagonal  matrix  with  the  following  typical  elements  each  of  which  has  an  inverse 


i  [u  (k)]  i  =  j 

h.  .  ;  k  =  1,  2,  . . .,  K 


ij 


(2.1.6) 


0 


i  ^  J 


2.  Class  P  invertible  systems:. 

This  class  contains  all  invertible  systems  not  contained  in  class  a. 

The  development  to  follow  will  explain  in  detail  a  procedure  for  optimi¬ 
zation  of  systems  which  are  class  invertible.  The  results  are  immediately 
extended  to  class  a  and  P  invertible  systems . 

A 

2.2  Statement  of  the  Problem 

Given  the  following  class  a1  invertible  system 


x(t)  =  f[x(t)]  +  B[x(t)  ]  u(t) 


(2.2.1) 
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determine 


u(t) 


such  that 


F[x(t),  u(t),  IT]  (2.2.2) 

is  minimized  and 

x  (t)  <  x(t)  <  jc+  (t)  (2  .2  .3) 

and 

u  (t)  <  u(t)  <  u+(t)  (2.2.4) 

all  for  t  €[o,T'].  Statements  such  as  (2.2.3)  signify  a  component  by  component 
relationship  between  vectors. 

We  will  assume  that  artificial  constraints  will'  be  imposed  in  the  absence 
of  any  components  of  (2.2.3)  or  (2.2.4).  These  will  be  of  the  form 

-L  <  x(t)  <  +  L;  -  L  <  u(t)  <  +  L, 

where  L  is  a  vector  of  suitably  large  positive  numbers. 
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The  terms  of  this  problem  statement  are  defined  below  for  t  £[0,T]. 


x(t) 

x^t) 

u(t) 

u-(t) 


f 

B 

F 


(n- dimensional)  state  vector 
(n-dimensional)  state  constraint  vectors 
(m-dimensional)  control  vector 
(m-dimensional)  control  constraint  vectors 
(n-dimensional)  system  vector 
(n  x  m  dimensional)  interaction  matrix 
performance  functional 


A  typical  example  of  the'  performance  functional  is 

J^T  n  m  n 

[a  2  xr(t)  +  b  2  us(t) ]  dt  +  p  £  lx.  (T) 

0  i=l  1  i=l  1  i=l  1  1  1 

The  control  vector  u°(t) ;  t  €[o,T],  which  satisfies  (2.2.2)  subject  to 
(2.2.1),  (2.2.3),  (2.2.4)  is  called  the  globally  optimum  control  vector.  If 
u ' (t) ;  t  €[0,T],  is  such  that,  for  all  6u(t) ;  t  £ [  0,  T ] ,  F[x'(t),  u'(t),  T]  < 

F[x ' (t)  +^x(t),  u'(t)  +  6u(t),  T ] ;  t  £  ['0,T],  then  u'(t)  is  a  locally  optimum, 
control  vector.  Note  that  the  perturbed  controls  and  states  must  satisfy  (2,2.3) 
and  (2.2.4)  and  5u.(t)  are  small. 

The  techniques  of  this  study  determine  a  locally  optimum  control  vector. 

To  find  the  globally  optimum  control  vector,  we  simply  select  the  best'  locally 

12  k 

optimum  one.  By  this  we  mean  that  if  u(t),  u(t),...,  u(t) ;  t  €[0,T]  are 

locally  optimal,  then  there  exists  a j  such  that,  for  all  i  4  j, 


F[^x(t),  '-’u(t),  T]  <  F  [ 1  x  ( t )  ,  1  u  ( t )  ,  T  ] ;  t  £  [  0,  T] . 
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We  call  ^u(t);  t  £[0,T]  the  globally  optimal  control  vector.  Since  the  number 
of  locally  optimal  control  vectors  may  be  very  large,  generally,  as  in  this 
work,  one  is  satisfied  to  find  a  locally  optimal  control  vector.  Moreover, 
in  many  problems,  physical  reasoning  shows  that  there  is  only  one  locally 
optimal  control  vector  and  therefore  it  is  globally  optimal. 
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3 .  A  SOLUTION 

3.1  Introduction  to  Solution 

The  method  of  solution  to  be  described  has  two  main  subdivisions .  First, 
the  state  space  constraints  at  time  k  +  1  are  mapped  into  the  control  space  at 
time  k.  These  constraints  along  with  the  control  space  constraints  at  time  k, 
determine  the  subspace  of  the  control  space  which  contains  all  admissible  sets 
of  controls  at  time  k.  This  is  the  constraint  mapping  procedure.  Next,  the 
control  at  time  k  is  selected  which  minimizes  a  pseudo  performance  index.  At 
the  end  of  a  major  iteration  it  will  be  shown  that  no  control  or  state  space 
constraints  are  violated  and  that  the  performance  index  originally  specified 
(in  (2.2.2))  is  strictly  smaller  than  it  was  at  the  end  of  the  previous  major 
iteration. 

The  present  chapter  contains  the  details  of  the  method  outlined  above. 

First  we  consider  the  constraint  mapping  procedure  in  some  detail,  then  discuss 
the  particularly  important  one  step  map'  which  will  prove  useful  later.  Next 
the  method  of  adaptive  constrained  descent  is  described.  This  technique  is  used 
both  for  the  mapping  and  later  for  the  optimization.  A  brief  discussion  of  the 
augmented  performance  index  follows.  The  chapter  concludes  with  a  detailed 
description  of  the  overall  optimization  procedure  using  the  schemes  described 
earlier  in  the  chapter. 

As  remarked  earlier,  this  work  is  especially  written  for  class  in¬ 
vertible  systems  as  explained  in  Chapter  Two. 

3.2  Constraint  Mapping 

It  is  convenient  to  define  several  sets  in  the  space  of  real  numbers.  The 
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course,  the  set  of  all  (k)  may  be  ordered  and  assembled  into  a  state  vector 

x(k)  at  time  k.  The  underline  signifies  a  vector  whose  components  are  Xj(k). 

In  the  control  space  we  have  the  following  sets  to  be  defined  below:  1U‘* , 

k; 

2  j  3  j  *  j  **  i 

V  uk>  V  In  general  the  subscript  indicates  the  time  at  which  the 

*  j  *  i 

set  is  defined  (i.e.,  U  is  the  set  U  at  time  k  =  1)  .  Thus,  for  example, 

*  *  j  th  * 

u  .  (k)  €  Ur.  is  the  j  element  of  a  particular  control  vector  u(k)  at  time  k. 
J  K  — _ _ 

cj)  is  the  null  set.  ft  is  the  real  line.  A  bar  over  a  set  (e.g.,  *uj')  denotes 
its  complement.  The  sets  are  defined  in  terms  of  the  problem  statement  of 
(2.2.1),  (2.2.2),  (2.2.3),  and  (2.2.4)  for  j  =  1,  2,  .  .  .,  m. 

The  technique  described  below  shows  ho w  to  construct  a  set  so  that 

"V  =  V  . 

k  k 
u ,  (k)  e  3uf 

J  K 


implies  violation  of  (2.2.1),  (2.2.3).  A  control 

3  i 

variable  selected  from  U.  is  sufficient  to  drive 

k 

the  system  outside  the  allowable  region  in  the 
state  space  (at  time  k  +  1) . 


uj(k)  e  "K 


implies  satisfaction  of  (2.2.4).  The  set  so  de¬ 
fined  is  the  connected  set  on  R  whose  boundaries 
are  u*(k)  and  u^ (k)  in  (2.2.4). 


u.(k)  e 
.1  k 


implies  satisfaction  of  (2.2.1),  (2.2.3).  A  control 

1’  i 

variable  selected  from  U,  necessarily  drives  the 

k 

system  into  an  allowable  state  at  time  k  +  1,  where 
the  allowable  states  are  defined  by  (2.2.3). 
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i 


X  -  x  n2»j 

u . (k)  ?  V 

J  K 


implies  satisfaction  of  (2.2.1),  (2.2.3),  (2.2.4). 

In  order  to  drive  the  system  into  an  allowable  state 
at  time  k  +  1,  it  is  necessary  and  sufficient  to  select 

**  j 

a  control  from  U,  . 


""i-  "in*-* 

u  ,  (k)  €  uf 
J  K 


implies  violation  of  (2,2.1),  (2.2.3),  and/or  (2.2.4). 

In  order  to  drive  the  system  into  an  allowable  (defined 

by  (2,2.3))  state  at  time  k  +  1,  it  is  necessary  to 

*  j 

select  a  control  from  U,  . 

k 


It  is  clear  that  all  these  sets  are  compact. 

**  -j 

The  set  U,  is  the  set  of  all  controls  which  are  candidates  for  the 
k 

"optimal"  control.  It  is  this  set  which  we  would  like  to  calculate.  It  will 
**  j 

be  shown  below  that  U,  is  a  function  of  the  state  and  the  control  at  time  k, 

k 

The  conjecture  is  made  that  for  general  systems,  or  even  for  general  invertible 

**  -j 

systems  U"  cannot  be  calculated.  An  example  is  given  which  shows  how  to  calcu- 
**  j  *  j 

late  Ur.  in  a  special  case,  A  set  Ur.,  the  construction  of  which  will  be  ex- 
plained,  is  a  function  of  the  present  state  of  the  system  and,  in  general, 
appears  to  be  the  smallest  set  which  can  be  easily  calculated  which  contains  the 
optimal  control.  This  question  of  a  "best"  is  a  subject  which  deserves 

JK 


further  attention.  It  is  not  discussed  in  this  work. 

*  i 

The  calculation  of  U  ,  called  a  one  step  map  is  easily  performed  for  the 


r  -T- 

class  invertible  systems  by  determining  its  endpoints  u-r(k) .  This,  it  will 


l 
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be  shown,  only  requires  examination  of  x-j(k  +  1) •  For  general  invertible  systems 

the  space  X  must  be  searched. 

K  +  JL 

*  i 

The  calculation  of  proceeds  as  follows: 

i 

1.  Calculate  :  Given  x(k':)),  search  x.(k.  +  1)  such  that  x.(k.  +  1)  < 

k..  i~ 1  J  l  j  i  - 

x.(k.  +  1)  <  x+(k.  +  1)  until  the  u.(k.)  of  the  inverted  system  reaches  its 
J  i  —  J  i  Ji 

maximum  and  minimum  values  .  These  boundaries  define  a  compact,  connected  set 

on  R . 
k. 

l 

2.  Calculate  2U^  :  u+(k.  )  and  u.(k.)  are  the  end  points  of  2U.^  on  R. 

k .  j  l  j  j.  k . 

i  i 


3  .  Calculate  *uf  :  ’V  =  'V  H  2uf  . 

k  k  k  1  '  k 


k. 

i 


In  general,  the  searching  operation  of  step  1  above  will  require  an  iterative 
numerical  procedure.  However,  if  the  inverted  system  can  be  represented  by 


u.  (k)  =  x.  (k  +  1)  -  g.  (x(k))  i  =  1,  2,  .  ...  m 

1  1  1  -  * 

k  =  1,  2,  .  . .,  K 


(3 .2  .1) 


then  u*(k)  will  occur  when  x^(k  +  1)  =  x*(k  +  1)  and  u^(k)  will  occur  when 
x^(k  +  1)  =  x^(k  +  1)  so  the  searching  procedure  is  unnecessary  for  the  case  of 
(3.2.1).  It  might  be  noted  that  most  systems  can  be  represented  as  in  (3.2.1). 

For  the  general  case,  a  numerical  procedure  has  been  developed  to  perform 
the  necessary  boundary  mapping.  A  description  of  this  procedure,  the  method  of 
adaptive  constrained  descent  is  given  in  the  next  section. 

In  light  of  the  preceding  discussion  of  constraint  mapping,  let  us  carefully 

examine  its  application  to  class  invertible  systems.  It  is  shown  later  that 

*  j 

we  are  interested  in  the  one  step  map  problem  which  yields  the  set  U" . 


For 
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the  Q^-type  systems 


x[k  +  A]  ?=  _f  [x(k) ,  A]  +  B[x(k),  A]  u(k) 

For  a  given  state  x(k)  we  can  write  (3.3.2)  as 

x[k  +  A]  =  f[x(k),  A]  +  v(k) 


(3.2.2) 


(3,2.3) 


where 


v(k)  =  B[x(k),  A]  u(k)  (3.2.4) 

For  independent  controls  ir(k)  this  transformation  always  has  an  inverse  and 
thus  u(k.)  can  be  determined  from  v(k) .  Equation  (3  ,2.3)  is  precisely  the  form 
desired  for  the  one  step  mapping. 

For  Q  -type  systems 

A 

x[k  +  A]  =  f[x(k);  A]  +  B[x(k);  A]  H[u(k)  ]  (3.2.5) 

where  H  is  the  diagonal  matrix  described  earlier.  The  requirement  here,  for  the 
successful  application  of  the  one  step  map  technique  is  that  h^i[u^(k)]  have  an 
inverse.  The  notion  of  linear  independence  is  not  present  here  and  it  is  diffi¬ 
cult  to  formulate  a  set  of  physical  requirements  on  a  system  for  this  condition 
to  exist . 

•  For  P-type  systems,  again,  it  is  difficult,  if  not  impossible,  to  discuss 
physical  interpretations  of  the  invertible  nature  of  non-linear  control  systems. 
A  thorough  study  of  this  problem  may  very  well  lead  to  useful  results.  For 
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the  purpose  of  the  present  study,  however,  such  problems  are  not  considered. 

**  -j 

This  section  is  concluded  by  a  discussion  of  the  existence  of  U,  .  It 

k 

*  j 

was  observed  earlier  that  we  could  find  a  U^.  which  is  a  function  of  jc(k)  .  If 
**  -j 

there  were  a  U£.  then  it  would  be  a  function  of  x(k)  and  u(k)  .  To  show  this, 
consider  the  following  general  inverted  system 


u^k)  =  xx(k  +  1)  -  g-^[x(k)  ] 

u2(k)  =  x2(k  +  1)  -  g2[xOO] 

u  (k)  =  x  (k  +  1)  -  g  [x(k)  ] 
mm  m 


(3.2.6) 


If  we  selected  **uy(k)  only  on  the  basis  of  xy(k  +  1)  and  x(k),  it  is  not  clear 

that  this  would  ensure  that  x  (k  +  1)  <  x(k  +  1)  <  x+(k  +  1) .  Counterexamples 

are  easily  found  to  show  that,  in  fact,  uy(k)  must  be  selected  on  the  basis  of 

more  information  than  xy(k  +  1) .  Let  us  suppose  that  because  of  coupling  be- 

**  +  +  . 

tween  equations  of  (3o2.6)  the  selection  of  u^OO  depends  on  x—(k  +  1)  as 

well  as  xq-(k  +  1).  Clearly  x  (k  +  1)  depends  on  u_(k)  also.  Therefore,  it  is 
12  2 
^  ^  I 

easily  seen  that  uy(k)  is  a  function  of  x(k)  and  u(k)  .  However,  u(k)  is  as 
yet  unknown.  For  each  u(k),  uy(k)  will  change  (as  will  the  other  u-(k)). 

So,  in  general,  it  is  impossible  to  find  **uy(k)  and  therefore,  for  computational 

**  j 

purposes,  it  does  not  exist.  There  are  special  cases  for  which  does 

exist  and  is  equal  to  as  determined  by  the  construction  described  earlier. 

1C 

Consider  a  linear-  system  represented  as  shown  below; 


x(k  +  1)  =  A(k)  x(k)  +  U(k);  k  =  1, 


2, 


K 


(3.2.7) 
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where 


A(k) 


0  1  0 - 0 

0  0  1  -----  0 

o - - -  1 


(k) 


n2 


(k) 


a 

nn 


(k) 


UT(k)  =  [0  0 - 0  u(k)  ] 


The  system  (3.2.7)  has  a  single  state  variable  constraint  x  (k)  <  x  (k)  <  x+(k) 

n  —  n  —  n 

and  a  constraint  on  the  single  control  u  (k)  <  u(k)  <  u+(k).  Because  the  only 
state  variable  constraint  is  on  the  one  variable  with  a  direct  input,  and  since 
there  are  no  other  inputs,  no  selection  of  U(k)  can  drive  the  variables  x^k  +  1), 
i  ^  n  into  inadmissible  regions  (for  inadmissible  regions  for  these  variables 

*  -j  **  -j 

do  not  exist).  Therefore,  the  procedure  for  determining  Uk  will  give  U^. 

This  is  a  special  case,  to  be  sure.  However,  it  does  show  an  interesting 
property  of  systems  which  correspond  to  all-pole  systems  in  the  continuous, 

stationary  case.  This  is  not  the  most  general  such  system,  but  is  satisfactory 

*  1 

for  the  purpose  of  exhibiting  a  system  for  which  the  which  we  know  how  to 

**  j 

calculate  is  identical  to  U,  . 

k 

The  fact  that  IT*  does  not  exist  in  general,  enhances  the  value  of  . 

k  k 

If  we  consider  the  optimization  process  to  be  a  search  of  admissible  controls, 

*  i 

the  existence  and  use  of  U  reduces  the  space  which  must  be  searched. 

k 

3.3  Adaptive  Constrained  Descent 

The  method  of  adaptive  constrained  descent  is  one  of  the  so-called  direct 
methods  of  minimization.  The  problem  is  to  determine  the  minimum  Z.1  =  f(x1) 
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—  i  + 

such  that  x  <  x  <  x  where  f  is  a  scalar  function  of  its  vector  argument. 
We  let 

Z°  =  min  Z1  =  f(x°)  . 

-  ^  o  ^  + 


The  technique  generates  a  set  of  x1  such  that  Z1  >  Zi+\  Thus  the  sequence  of 

Z1  is  monotonically  decreasing.  If,  for  i  =  P  the  technique  cannot  produce 

[  P+1  P  P  o  P  o 

Z  <  Z  ,  then  Z  =  Z  and  x  =  x  ,  the  minimizing  value  of  x  or  at  least  a  sad^ 

,  die  point  of  f(x). 

The  minimization  proceeds  down  one  variable  at  a  time  within  the  restricted 
region.  Each  variable  is  changed  until  the  sensitivity  of  Z  with  respect  to 
that  variable  has  been  sufficiently  reduced.  The  amount  by  which  the  j-th 

I 

1  variable  is  changed  at  each  step  is  .  Initially  6^  is  set  to  an  appropriate 

value.  Experience  shows  that  for  many  problems  C.  =  (x+  -  x.)/3  is  a  reason- 
(  J  J  J 

able  value  to  start  with.  The  minimization  on  one  variable  is  continued  until 

|  the  sensitivity  of  Z  with  respect  to  this  variable  is  sufficiently  reduced. 

During  this  minimization  on  one  (the  j-th)  variable,  6.  is  reduced  to  permit 

( 

\  partial  covergence  to  the  minimum  in  one  variable.  When  the  sensitivity  of  Z 

with  respect  to  this  variable  is  reduced  below  a  cut-off  value  (minor  cycle 

l 

sensitivity  criterion)  a  minor  cycle  is  complete.  If  x  is  an  n- vector,  n  minor 
I  cycles  constitute  a  major  cycle. 

X  8 

The  details  of  the  method  may  be  found  in  Appendix  A  and  elsewhere 
\  3.4  A  Pseudo  Performance  Index 

^  For  numerical  purposes,  it  may  be  helpful  to  introduce  an  augmented 

performance  index  to  account  for  state  space  violations  which  occur  at  "future" 

|  times.  This  idea  will  become  clear  later.  We  introduce  the  augmented  per¬ 

formance  index  H[x(k),  u(k),  k]  defined  as  the  "cost"  of  going  from  x(k) 


20 


to  x(K) . 

H[x(k) ,  u(k).,  k]  =  F[x(k) ,  u(k),  K]  +  G[x(k)] 

G[x(k)]  is  the  penalty  incurred  for  violating  the  state  space  constraints. 
{We  will  insure  that  G[x(k>]  =  0  at  the  conclusion  of  the  iterative  process.) 

A  convenient  form  for  G[x(k)]:  is 

n  K  _  .  r  -2 

G[x(k)  ]  =  2  2  x  46  [x.(k>  -  x+(k)  ]  +  6  [x.  (k)  -  x  (k)  ]  }  ■lx.  (k)  -  x.  (k)  V 

1=1  k=k  ik  1  - 1  i  l  -li  l  JLi  i  J 


where 


and 


* 

x.  (k) 

l 


x^ (k)  +  x*(k) 
2 


8  (a)  =  jO  a  <  0 

1  1  a  >  0 

Unless  otherwise  mentioned  we  use  X.  ,  =1,  The  minimum  of  F  which  is  selected 

lk 

may  depend  on  X.  . 

Using  the  one  step  mapping  procedure  we  can  ensure  that  the  state  space 
constraints  at  one  instant  will  not  be  violated.  G[x(k)]  will  account  for  those 
at  later  instants  which  are  violated.  At  any  particular  time  k^,  we  can  be  sure 
that  there  are  no  state  or  control  space  constraint  violations  for  k  <  k^;  and 
at  k^  =  K,  we  can  be  sure  there  are  no  state  space  constraints  violated  at 
any  time. 


! 
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3 .5  Direct  Fixed-Time  Optimization  of  Invertible  Systems 

Let  us  assume  that  we  have  no  prior  knowledge  of  the  optimal  control  and 
that,  as  an  alternative  to  prior  knowledge,  we  have  selected  u.  (k)  =  (J-;  i  =  1, 

2,  . . .,  m  and  k  =  1,  2,  . K,  ,  Moreover,  with  this  "control",  the  value 
of  the  performance  index  is  °H  =  °F  +  °G  where  H  and  G  were  defined  in  the 
previous  section.  F  was  defined  in  (2.2.2).  The  optimization  procedure  is 
made  up  of  minor  iterations  and  major  iterations.  If  there  are  K  time 
instants  between  k  =  1  and  k  =  K,  then  one  starting  iteration  and  K  minor 
iterations  comprise  one  major  iteration, 

The  starting  iteration  is  the  search  for  "best"  initial  conditions  on  the 
state  variables  .  It  is  simply  a  search,  using  the  adaptive  constrained  descent 
procedure,  over  the  set  of  starting  values  whose  boundaries  are  x~(l)  and  a 
selection  of  the  one  which  minimizes  the  augmented  performance  index.  The  de¬ 
tails  of  the  search  are  the  same  as  for  any  of  the  control  vectors,  for  example 
_u(l),  and  are  given  below. 

The  minor  iteration  has  several  parts.  Upon  entering  a  minor  iteration 
at  time  k,  the  following  information  is  known:  x(k),  x^(k  +  1),  vr-(k), 

H[x(k),  u(k),  k]_.  Moreover  we  have  constructed  the  control  up  to  time  k  so 
that  G[ x.(  1 )  ]  =  G[x(k)  ],  which  means  that  ,  there  ape  no  ;  state  space  constraint 
violations  before  time  k.  With  this  information  the  iteration  proceeds. 


1. 
2  . 

3, 

4. 


i  *  1 


*  i 


Use  the  one  step  mapping  technique  to  determine  U! 

Select  a  u.  (k)  £  *U . 

1  K 

Check  to  see  if  x  (k  +  1)  <  x(k  +  1)  <  x+(k  +  1) .  That  is, 

check  to  see  if u  (k)€  U  .  If  this  is  true  go  to  5.  If  not, 
i  k 


go  to  3  . 
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i 

5 ,  Compute  H[x(k);  u(k),  kj.  Continue  selecting  u. (k)  6  U 

l  k 

until  H[x(k),  u(k)j  k]  is  minimized  (using' the  method  of 
Section  3.3) . 

6.  If  i  ^  n,  increase  i  by  one  and  go  to  2.  If  i  =  n,  keep  a 
record  of  the  current  H[x(k),  u(k),  k]  and  compare  it  with 
previous  values.  If  no  significant  decrease  has  occurred, 
this  completes  the  minor  iteration.  If  a  significant  de¬ 
crease  has  occurred,  go  to  1. 

Thus,  at  the  end  of  a  minor  iteration  at  time  k,  u(k)  has  been  set  so  that 

*  i 

each  u.(k)  €  U  ,  no  state  space  constraints  at  time  k  +  1  are  violated 

1.  K 

(therefore,  all  u.(k)  €  U  •  i  =  1,  2,  , . . ,  m) ,  and  u(k)  is,  in  some  sense, 
"best"  to  date.  Moreover,  at  the  end  of  the  minor  iteration  the  states  and  con¬ 
trols  for  all  previous  instants  have  been  calculated  and  stored.  Also,  the 
portion  of  H[x(l),  u(l),  l]  which  depends  on  these  states  and  controls  has  been 
calculated  and  stored.  Thus,  the  calculation  time  is  shortened  as  the  calcu¬ 
lation  proceeds. 

A  major  iteration  consists  of  one  starting  iteration  and  K  minor  iterations 
and  thus  represents  a  complete  pass  through  the  controls  u(k),  k  =  1,  2,  ...,  K. 
(See  Appendix  B.) 

A  discussion  of  the  stability  of  the  method  proposed  above  and  its  ability 
to  converge  to  a  critical  point  of  F  is  given  here.  First  we  show  a  source  of 

p 

instability  of  this  technique.  Suppose  that  F  =  .  T  at  the  end  of  a  major  : 
iteration.  The  next  minor  iteration  will  select  a  set  of  vector  components 
ui(l),  i  =  1,2,...,  m,  which  reduces  the  performance  index  to  1F  where  1F  <  °F. 
This  new  control  u(l)  in  general  will  change  the  state  of  the  system  x(2), 
x(3),  ...,  x(K) .  To  calculate  u(2),  for  example,  we  need  the  new  value  of 
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*  J 

TT*-'  m 


x(2)  to  determine  j=l  2,  ...,m.  It  is  possible  that  the  set  if?  does  not 

contain  the  former  "best  estimate"  for  u.(2)  and  so  the  old  u.(2)  cannot  be 

•3  J 

selected  as  an  admissible  control.  This  is  true  because  the  use  of  u.(2) 

2  i 

would  violate  some  constraint  on  x.(3),  or  else  is  not  in  Ur.  (This  follows 
from  the  definition  of  U^.)  Therefore  it  is  possible  that  we  cannot  find 

*  j  2  2  1 

u.(2)  €  in  which  results  in  a  F  such  that  F  <  F  and  in  this  sense  the 
J  « 

procedure  is  not  monotonic.  The  source  of  difficulty  here  is  large  differences 

*  j 

in  the  contents  of  successive  U^.  These  large  changes  may  either  arise  from 
discontinuities  in  the  derivatives  of  the  state  vector  x(k)  or  from  large' 
changes  in  successive  values  of  the  input  u(l).  In  most  physical  systems 
x(k)  is  continuous  and  therefore  this  generally  will  not'  be  the  source  of 
difficulty.  The  most  frequent  cause  of  the  trouble  will  be  successive  values 
of  u(l)  which  are  considerably  different.  As  observed  in  the  examples  of 
Chapter  Four,  the  first  major  iteration  typically  results  in  a  value  for  the 
performance  index  which  is  well  over  ninety  percent  of  its  optimum  value 
and  values  for  u(k),  k  =  1,  2,  . ..,  K-l,  which  are  close  to  their  optimum 

values.  Successive  changes  in  u(k)  are  generally  very  small.  Thus  successive 
*  j 

U  generally  differ  by  very  little  and  thus  this  non-monotone  character  of 

K 

the  iteration  seldom  is  observed.  This  is  especially  true  if  G  is  comparable 
to  F  in  magnitude  so  future  state  space  constraints  are  "strongly"  considered 
as  each  component  of  u(k)  is  selected.  For  the  examples  studied  by  the 
author,  no  non-monotonic  behavior  was  observed. 

If  successive  passes  through  all  variables  produce  no  further  decrease 
in  H,  its  value  at  the  end  of  a  major  iteration,  that  is  F[x(k),  u(k),  K], 
is  at  a  critical  point  (not  a  maximum)  subject  to  the  constraints  on  the 
states  and  controls.  If  the  function  F  has  saddle  point  behavior  in  the  m 
times  (K-l)  variables  u^k),  i  =  1,  2,  . ..,  m;  k  =  1,  2,  ...,  K-l,  the 


\ 
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critical  point  located  may  not  be  a  minimum.  This  is  clear  since  the  'one 
at  a  time'  search  procedure  cannot  distinguish  certain  saddle  points  from 
minima.  If  the  performance  index  F  has  no  saddle  point  behavior ,  the  point 
of  inflection  located  is  a  local  minimum. 

Now  that  the  method  has  been  described  it  should  be  clear  why  we  are  re¬ 
stricted  to  fixed-time  problems.  The  constraints  are  fixed  in  time  initially 
and  the  system  is  forced  to  move  through  the  restricted  region  of  the  state 
space.  It  is  not  clear  at  this  time  whether  or  not  minimum  time  problems  (for 
example)  could  be  handled  using  this  technique. 

A  question  which  remains  to  be  answered  concerns  the  ability  to  satisfy 

the  state  space  constraints  at  the  next  instant.  It  may  occur  that  at  a  parti- 

*  it 

cular  instant  k,  the  XT'  which  we  have  described  earlier  is  empty.  This  may 

occur  for  various  reasons.  For  instance,  there  may  be  no  solution  to  the 

problem  (e.g.,  because  of  inconsistent  specifications).  It  may  be  that  be- 

*  i 

cause  the  current  x(k)  is  not  optimum,  the  to  be  calculated  is  empty. 

Work  remains  to  be  done  to  determine  whether  or  not  the  problem  has  a  solution 
and,  if  it  does,  to  develop  a  technique  to  account'  for* -this,  particular ■  time 
instant  which  seems  to  have  no  admissible  controls. 
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4.  EXAMPLES 

In  this  chapter  the  method  described  earlier  is  applied  to  three  specific 

problems.  The  first  problem  is  deliberately  chosen  to  be  simple  and  it  is  easy 

to  follow  the  details  of  the  method.  The  problem  is  stated  as  a  discrete  one 

in  order  to  eliminate  the  necessity  for  considering  the  relationship  between 

differential  and -difference  equations.  A  discussion  of  such  matters  may  be 
19 

found  elsewhere 

The  second  and  third  examples  are  problems  described  elsewhere  but  not 
solved  numerically.  A  detailed  discussion  of  the  origin  and  significance  of 
the  problems  and  their  solution  are  to  be  found  in  Sections  4.3  and  4.4. 

The  examples  to  be  described  were  programmed  on  the  Control  Data  Corporation 
1604  in  the  Fortran  compiler  language.  The  program  is  written  so  any  problem 
of  the  type  considered  (i.e.,  invertible  systems)  can  be  run  by  changing  only 
three  subprograms  .  In  these  subprograms,  the  system,  the  inverted  system  and 
the  performance  index  are  described.  Data  to  the  program  includes  range  of 
initial  conditions,  state  and  control  space  constraints,  final  time  and  step 
size  and  a  list  of  parameters  which  may  be  used  as  desired. 

A  block  diagram  of  the  program  is  shown  in  Appendix  B.  The  terminology 
of  the  flow  chart  is  the  same  as  in  Chapter  Three. 

Several  observations  about  the  examples  are  in  order..  First,  all  curves 
are  drawn  with  continuous  lines  joining  data  points.  This  is  to  help  visualize 
the  results  only.  Actually  data  only  exists  at  a  discrete  set  of  points  which 
are  clearly  marked  on  each  sheet . 

The  trajectory  problems  show  a  very  strong  sensitivity  to  initial  condi¬ 
tions.  For  this  reason,  the  ability  to  optimize  initial  conditions  as  well 
as  controls  is  of  fundamental  importance.  In  practice  it  is  frequently  true 


that  initial  conditions  may  be  selected  within  a  certain  range.  The  trajectory 
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examples  indicate  that  substantial  advantages  exist  by  careful  choice  of  these 
initial  conditions  . 

One  point  of  significance  is  the  effect  of  multipliers  on  the  performance 
index.  In  the  examples  shown  in  this  chapter  terminal  constraints  are  handled 
by  means  of  penalty  functions,  i.e.,  positive  semi-definite  functions  of  the 
difference  between  actual  and  desired  final  states  .  Each  terminal  constraint 
is  weighted  according  to  its  importance  relative  to  fuel  cost,  thrust  limitations, 
vehicle  lifetime,  etc.  Proper  selection  of  the  weighting  factors  can  be  of 
considerable  importance  in  obtaining  realistic  answers .  Much  more  should  be 
said  about  these  considerations.  However,  this  is  not  the  place  for  it.  It  is 
sufficient  to  say  that  a  poor  choice  of  weights  will  preclude  a  realistic  solu¬ 
tion  of  these  optimization  problems  . 

4.1  Example  One  -  A  Discrete  Linear  System 

Figure  4.1-1  shows  a  block  diagram  of  the  system  under  consideration.  Its 
state  vector  representation  is  given,  below: 

xx(k  +  1)  =  -x1(k)  +  *2(k)  +  u1(k) 

x2(k  +  1)  =  +x1(k)  -  x2(k)  +  u2(k)  (4.1.1) 

k  =  1,  2,  . . ..,  10 

State  and  control  space  constraints  shown  in  Figure  4.1-2  are 


x(l)  =  1 
-  1  <  x(k)  <  +  1 


(4.1.2) 


-  1  <  u(k)  <  +  1 


where  *1  represents  a  two-vector  both  of  whose  elements  are' +1  or  -1,  re¬ 
spectively. 
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The  performance  index  chosen  for  this  problem  is: 

2  9  2  2  9  2 

F  =  k^2  Xj(k)  +  j?l  uj(k)  +  M  I  x.^10)  -  "5  I  (4.1.3) 

where  M  is  a  constant  chosen  to  drive  x^(10)  sufficiently  close  to  .5, 

Initial  conditions  selected  are  x  (1)  =  x  (1)  =  +1.  Initially  the  optimal 

JL  <£ 

control  is  guessed  to  be  u(l)  =  0 ,  k  =  1,2,... ,10. 

With  M  =  1.0,  Figures  4.2-3  and  4.2-4  show  the  state  variables  at  the  end 

of  certain  major  iterations.  Figures  4.2-5  and  4.2-6  show  the  control  variables 

for  certain  major  iterations. 

The  value  of  the  performance  index  shown  in  Figure  4.2-7  is  seen  to  decrease 
monotonically  with  the  number  of  major  iterations  as  explained  in  Chapter  Three. 

If  we  consider  (just  for  illustration)  that  its  final  value  is  .115,  then  it 

is  within  .03  of  its  final  value  after  just  one  iteration.  That  is,  in  one 

iteration  it  has  decreased  more  than  99.999$.  of  the  total  decrease  to  be  ex¬ 
pected.  It  might  be  noted  that  many  numerical  procedures  converge  extremely 
quickly  during  the  first  few  iterations,  then  quite  slowly  after  thaf;.  Using 
the  FORTRAN  program  mentioned  above,  each  (major)  iteration  required  about  ten 
seconds  on  the  CDC  1604. 

One  other  appropriate  remark  involves  the  results  shown  in  Figures  4,1-3 
and  4.1-4.  There  at  the  zeroth  iteration  we  note  that  state  space  constraints 
are  violated.  This  results  from  certain  of  the  controls  being  inadmissible. 

In  the  terminology  of  Chapter  Three,  certain  of  the  "first  guess"  controls  are 
not  in  Ur  although  it  is:  seen  that  they  do  belong  to  UJ .  The  method  assures 

K  K 

that  this  will  not  occur  for  any  other  major  iteration. 


} 

Figure  4.1-3.  (Example  One)  Convergence  to  Optimal  Trajectory 
x^(k)  vs.  Time 
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Discrete  time  (k) 


Figure  4.1-3.  (Example)  Convergence  to  dptimal  Trajectory 
x  (k)  vs .  Time 


Discrete  time  (k) 


Figure  4.1-6.  (Example  One)  Convergence  to  Optimal  Control  u2(k)  vs.  Time 
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Major  iteration  number 


e  4.1-7.  (Example  One)  Performance  Index  vs.  Major  Iteration  Number 
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4.2  Example  Two  -  A  Midcourse  Guidance  Problem 

In  this  example  the  problem  of  interorbit  transfer  or  more  commonly,  the 

20 

midcourse  guidance  problem  ,  is  examined.  Consider  the  equations  of  motion  of 
the  center  of  mass  of  a  vehicle  moving  in  two  dimensions  in  the  earth's  gravi¬ 
tational  field.  The  geometry  of  this  two-dimensional,  restricted  two-body 
problem  is  shown  in  Figure  4.2-1.  The  equations  follow: 


where 


r 


2 


ri02 


0 


2 


r202 

.2  _f_l  + 


(4.2.1) 


N  =  GM  =  1014  nm^/Kg . 

G  =  universal  gravitational  constant 
M  =  mass  of  the  earth 

3 

m  =  mass  of  vehicle  =  10  Kg. 


To  use  the  notation  of  the  other  examples  we  define  r^  =  x^,  r^  =  x2, 

0  =  x  ,  0  =  x  .  We  will  consider  that  the  vehicle  is  to  be  placed  into  an 
earth  orbit  which  takes  it  through  a  certain  "launching"  region  in  space.  From 
the  optimal  point  (to  be  selected)  in  this  "launching"  region  the  vehicle  is  to 
be  transferred  to  a  specified  point  in  a  different  orbit  in  a  given  length  of 
time.  Minimum  fuel  is  to  be  used  and  each  rocket  has  a  specified  maximum  thrust. 
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The  main  thruster  is  constrained  to  exert  force  only  in  the  +r  direction.  The 
transverse  rockets  exert  force  in  the  ±0  directions .  We  are  to  determine  the 
optimum  '’launch'''  point  and  control  program  subject  to  certain  constraints. 
Specifically,  the  constraints  are  given  below. 


°  <  u  <  500 

-200  <  u  <  +  200 

4 


(4.2  .2) 


960 


We  want  to  minimize 


Jo 


2  2 

(u  (t)  +  u  (t))  dt  where  force  is  in  newtons,  time  in 

JL 


seconds,  length  in  meters,  mass  in  kilograms,  and  angles  in  radians.  The  ini¬ 
tial  state  is  given  by 


x-(0)  <  x(0)  <  if  ( O') 


where 


7  ” 

+  . 

7 

10 

;  x  (0)  = 

10 

0 

0 

0 

1 

0 

.005 

The  final  desired  state  is  specified  by  only  two  components  of  the  state  vector 
7 

x  (960)  =  1.5x10  ,  x  (960)  =1.0  and  the  other  components  are  free.  Figures 
1  3 

4. 2-52  and  4.2-3  show  the  optimum  trajectory  and  Figure  4.2-4  shows  the  optimum 
control.  (Strictly  of  course  these  are  only  close  to  the  optimal  control.  This 
is  clear  by  examining  Figure  4.2-5.)  For  this  problem,  relatively  little  con¬ 
trol  effort  is  required.  The  initial  conditions  which  are  adjustable  have  a 
pronounced  effect  on  the  trajectory.  With  a  properly  selected  initial  state, 
the  vehicle  requires  only  little  control  effort. 


Time  (in  sec) 


Figure  4.2-2.  (Example  Two)  Radial  Distance  vs.  Time 
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Figure  4.2-5  shows  the  behavior  of  the  performance  index  for  this  problem. 
This  figure  exhibits  the  rapid  'convergence'  properties  mentioned  in  connection 
with  Example  One. 

The  performance  index  used  for  this  problem,  was 


F  =  .001 


•X 


960 


(u^(t)  +  u^(t))  dt  + 


x  (960) 


1.5xl0? 


Xg (960)  - 


1.0 


4 .3  Example  Three  -  A  Lunar  Landing  Problem 

The  problem  of  landing  manned  or  unmanned  vehicles  on  the  lunar  surface 

is  an  important  one  currently  being  studied.  There  are  several  formulations 

2 

of  the  problem,  the  one  here  being  due  to  Friedland  .  In  Figure  4.3-1  the  co¬ 
ordinates  r  and  0  are  defined,  r  is  the  distance  from  the  moon’s  center  and 
0  is  a  measure  of  angular  position.  As  in  the  previous  example  we  assume  two 
sets  of  rockets  are  mounted  on  the  vehicle,  one  which  exerts  force  in  the  +r 
direction  and  a  smaller  pair  to  exert  thrust  in  the  + 0  directions .  Since  the 
vehicle  is  assumed  to  be  in  the  vicinity  of  the  moon  when  this  phase  of  the 
flight  begins,  three  basic  assumptions  are  employed  in  the  following  derivation. 
First  it  is  assumed  that  the  total  mass  of  fuel  required  for  the  descent  is 
small  compared  to  the  mass  of  the  vehicle  so  the  vehicle  mass  may  be  assumed 
constant.  The  flight  time  of  this  phase  is  small  with  respect  to  the  moon's 
period  about  the  earth  (about  1  revolution/28  days)  so  that  Coriolis  and  centri¬ 
fugal  forces  arising  from  rotation  of  the  coordinate  system  (origin  at  earth, 
rotating  with  moon)  may  be  neglected.  Since  r/r^  is.  .•vqry  .small  for,  this  phase, 

terms  in  r/r  of  first  and  higher  order  will  be  neglected  if  compared  with  unity, 
o 

g  ,  R  ,  M  are  the  lunar  gravitational  acceleration.,  radius  and  mass, 
m’  m 


respectively . 
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S3  M  are  the  earth’s  gravitational  acceleration,  radius  and  mass, 
e  '  ’ 


respectively . 


v^  is  the  escape  velocity  from  the  moon's  surface  (neglecting  the  earth’s 


presence) 


v  -•  2g 
e 


„2 

M 

R 

m 

M 

R 

e 

m 

1/2 


T  -  a  733  sec,,  t  =  t/T 
e  v  '  e 

e 


,  M  R 

K  -  \  --- V  «  ,0084 

Mr 
m  o 


R  f 

m  r 

U1  “  2  fr  =  3“°3  W“ 

v  m 
e 


K  fB 

u2“-S“f0"3*O3r 

v  m 
e 


W  ~  weight  of  vehicle  on  earth. 

With  these  definitions  and  assumptions  we  can  write  the  equations  of 
motion . 


dx 

dT 


I/-,  ,  2  1 

(1  4-  x  )  x  -  - —  4-  K  cos  x,  4-  u. 


3  2  2(1  4-  x3)2 


4  1 


dx2  2X1  *2  K  Sin  X4  U2 
dT  1  4  x3  1  +  x3  +  1  +  x3 


dX3 

dT  “  X1 


(4,3,1) 


dT  x2 


where 

x^  is  a  normalized  radial  velocity 

x^  =  1  is  the  moon*s  escape  velocity 

x2  is  a  normalized  angular  velocity 

Xg  is  a  normalized  radial  distance 

x^  —  0  is  one  moon  radius  (denoting  the  lunar 

surface) 

x^  is  exactly  the  angle  0= 

The  problem  solved  here  used  the  following  constraints: 

0  <  u1(k)  <  10.0 
-5.0  <  u0(k.)  <  +  5.0 
x3(k)  >  0 

<  x(l)  <  -0.2 

+0.5 
+0.2 
-2.0 

24 

2  u  (k)  <  20.0 
fc=l  1 

24 

k-1  U2(k)  50  ”° 

t  =  0  corresponds  to  k  tr.  1 
t  a  2.4x733  sec.  corresponds  to  k  =  25 

Time  between  successive  values  of  k  is  73.3  sec.  The  quantity  to  be  minimized 
is  fuel  consumption: 

24  |  | 

fc|?l  ui(-k)  +  u2<'k'> 


Figure  4.3-2.  (Example  Three)  Radial  Distance  vs.  Time 
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Time  instants  (73.3 sec  each) 


Figure  4.3-3.  (Example  Three)  u^(k)  vs.  Time 
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This  is  a  "difficult"  problem  because  of  the  large  initial  value  of  radial 
velocity  x^CO) .  With  no  control,  it  was  found  that  the  final  value  of  x^  was 
-91,  a  rather  unreasonable  number. 

The  curves  of  Figure  4.3-2  show  the  result  of  using  a  state  variable 
constraint  x^(k)  >  0  to  prevent  the  vehicle  from  "going  under  the  lunar  surface". 
The  control  effort  required  to  obtain  this  trajectory  is  shown  in  Figures 
4.3-3  and  4.3-4. 

Six  major  iterations  of  about  45  sec.  each  were  required  for  each  of  the 
two  runs . 
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5.  PERSPECTIVE  -  II 

5 . 1  Summary 

A  numerical  technique  for  calculating  the  optimal  control  for  a  class  of 
systems  and  constraints  is  described.  Nonlinear,  time-varying  deterministic 
systems  subject  to  hard  state  space  and  hard  control  space  constrains  are  con¬ 
sidered.  Three  numerical  procedures  are  developed  to  perform  the  optimization. 

A  technique  for  the  minimization  of  a  scalar  function  of  a  vector  variable  is 
described  where  the  variables  are  constrained  by  upper  and  lower  bounds.  This 
minimization  procedure  is  incorporated  in  a  method  of  constraint  mapping  which 
maps  the  state  space  constraints  into  the  control  space.  To  improve  convergence 
properties  of  the  optimization  procedure  the  notion  of  a  pseudo  performance  in¬ 
dex  is  introduced.  Initial  and  final  states  may  be  partially  or  completely 
specified.  Any  unspecified  initial  or  final  state  vector  components  are  opti¬ 
mally  selected. 

An  iterative  technique  for  the  optimization  is  demonstrated  which  gener¬ 
ally  converges  to  a  local  minimum  of  the  performance  index.  The  method  uses 
the  direct  approach  to  optimization  and  is  very  efficient  computationally. 
Examples  of  space  vehicle  trajectory  optimization  problems  are  given.' 

5.2  Critique 

This  thesis  is  intended  as  an  introduction  to  a  particular  approach  to 
totally  constrained  optimization  problems.  The  systems  which  can  be  optimized 
using  the  techniques  given  earlier  are  quite  general .  However,  certain  re¬ 
strictions  were  found  to  be  helpful.  The  notion  of  invertible  systems  is,  to 
the  author'#  knowledge,  one  which  has  not  been  explored  before.  The  question 
naturally  arises  concerning  the  necessity  or  desire  for  studying  invertible 
systems.  It  turns  out  that  many  common  systems  currently  under  study  are  in¬ 
vertible.  Is  there  something  inherent  in  the  structure  of  invertible  systems 


which  makes  them  of  particular  interest?  Maybe  they  are  not  of  particular  inter¬ 


est.  It  would  seem  that  further  effort  might  be  expended  in  this  direction. 

The  use  of  direct  optimization  methods  is  not  "in  style"  these  days.  It 
does  not  appear  that  adequate  justification  for  this  state  of  affairs  has  been 
given.  : The  contribution  of  this  thesis  is  based  on  a  direct  approach  to  opti¬ 
mization  problems  and  the  author  feels  that  more  effect  should  be  devoted  to  this 
area  of  technology. 

To  be  more  specific  concerning  the  results  obtained  in  this  thesis,  there 
is  one  particular  difficulty  which  may  arise.  Examples  can  be  found  to  produce 

v 

the  following  effect.  What,  explanation  might  be  given  if,,  during  the  optimi¬ 
zation  procedure,  it  was  discovered  that  no  control  could  be  found  to  satisfy 
state  space  constraints?  If  that  happened,  there  are  two  possible  explanations. 
Either  the  problem  as  stated  has  no  solution  or  else  the  method  has  led  us  astray. 
We  will  assume  that  at  time  k. ,  it  is  determined  that  there  are  no  admissible 
controls.  This  implies  that  the  state  or  control  space  constraints  (or  both) 
are  "too  tight"  at  this  step  in  the  optimization  procedure.  If  we  know  (from 
physical  reasoning,  perhaps)  that  a  solution  does  exist,  we  must  then  "invent" 
a  technique  for  determining  it.  A  method  which  could  be  used  is  to  loosen  the 
constraints  for  the  initial  major  iterations,  then,  as  the  optimum  control  is 
approached,  to  tighten  them  to  their  correct  vlaues.  We  are  still  left  with  the 
question  of  existence  if  this  scheme  fails  to  generate  an  admissible  control. 
Without  quantitative  results  it  would  seem  that  this  constraint  tightening  scheme 
would  eliminate  this  trouble.  However,  there  is  much  to  be  done  in  this  con- 

i 

*  j 

nection.  One  test  which  might  well  be  performed  is  to  calculate  for  all  j 

*  i 

and  k.  If  we  find  any  given  Uj^  =  cj>  then  this  surely  means  there  is  no  solution 

*  i  **  -j  **  i  , _  *  -j 

because  U,  =  <$>  implies  that  U,  =  <f>  since  ir  CUT  Ur.. 

J£  K  K  —  K 
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A  significant  advantage  of  the  method  proposed  over  other  computational 

schemes  is  shorter  computation  time.  Running  times  for  the  three  examples  were 

given  in  Chapter  Four.  These  times  are  less  because  of  inherent  computational 

advantages  of  direct  methods  over  indirect  ones  and  also  because  of  the  number 

of  "sampling"  intervals  considered.  Just  to  mention  one  aspect  of  the  indirect 

approach,  two  point  boundary  value  problems  are  quite  costly  with  respect  to 

computation  time.  (Details  of  the  two  point  boundary  value  problem  may  be 
21 

found  elsewhere  .)  Using  the  method  of  this  thesis,  many  fewer  partial  de¬ 
rivations  are  needed  since  we  do  not  require  travel  in  the  direction  of  steep¬ 
est  descent;  many  fewer  equations  need  to  be  integrated  because  we  do  not  use 
adjoint  systems,  etc.  On  the  other  hand,  the  problem  of  assured  convergence 
mentioned  above  is  not  to  be  underestimated .  We  can  only  point  out  that  no 
work  has  been  published  to  date  which  provides  a  computationally  efficient 

method  for  solution  of  the  nonlinear  time-varying  problem  with  many  state  and 

16 

control  space  constraints.  The  work  of  Bryson  and  Denham  is  the  first  ef¬ 
fective  step  in  this  direction  using  indirect  techniques. 

5  .3  Comments  on  Further  Engineering  Research 

Scattered  throughout  this  thesis  are  ideas  and  suggestions  for  further 
work.  In  this  section,  some  of  these  ideas  are  collected.  For  this  work,  we 
have  limited  our  state  space  and  control  space  constraints  to  those  of  the  form 
of  (2.2.3)  and  (2.2.4)  rather  than  considering  Q[x(k),  ij(k),  k]  >  0.  It  is  true 
that,  in  certain  cases,  the  constraints  considered  here  will  not  be  adequate. 
However,  it  is  also  true  that  when  these  constraints  represent  meaningful 
physical  limitations  we  have  demonstrated  an  optimization  technique  possessing 
unusual  computational  efficiency.  We  have  traded  generality  for  this.  This 
trade  is  called  engineering  judgment  and  such  judgment  should  pervade  engineer¬ 


ing  research. 


One  area  of  further  study  should  be  to  discover  what  engineering  approxi¬ 
mations  and  simplifications  can  be  used  to  improve  existing  theoretical  results 
to  make  them  more  practical  for  "real  world"  applications.  The  notion  of  in- 
vertibility  may  be  of  some  importance  for  future  analysis  techniques.  The  method 
proposed  should  be  extended  to  non-fixed-time  problems .  More  general  constraints 
may  be  considered  and  new  results  found  there. 

An  engineering  constraint  which  deserves  more  attention  is  that  of  piece- 
wise  constant  controls  in  continuous  systems.  The  physical  nature  of  some  con¬ 
trolling  devices  indicates  that  this  is  an  area  of  no  small  importance. 

The  idea  of  constraint  mapping  discussed  in  these  pages  may  be  extended, 
for  example,  to  performance  index  mapping  in  order  to  permit  the  actual  opti¬ 
mization  to  take  place  strictly  in  the  control  space.  There  seems  to  be  much 
additional  work  to  be  done  in  this  field  of  mapping  for  optimization. 

A  feedback  solution  to  the  problem  posed  in  this  work  would  be  a  welcome 
addition  to  current  research  results.  There  is  little  work  in  the  literature 


on  this  subject. 


54 


Bibliography 

1.  Zadeh,  L.  A.,  "From  Circuit  Theory  to  System  Theory,"  Proc.  of  the  IRE, 

Vol.  50,  No.  5,  pp.  856-865,  May  1962. 

2.  Friedland,  B„,  "Optimum  Space  Guidance  and  Control,"  Technical  Note  62/3, 
Melpar,  Inc.,  June  1962. 

3.  Kahne,  S.  J.,  "A  Constraint  Mapping  Technique  for  System  Optimization," 

IEEE  International  Convention  Record,  Vol.  11,  1963. 

4.  Pontryagin,  L.  S.,  Boltyanskii,  V.  G.,  Gamkrelidze,  R.  V.,  Mishchenko,  E.F., 
The  Mathematical  Theory  of  Optimal  Processes,  [English  translation  by 
Trirogoff  and  Neustadt  ],  Interscience  Publishers,  1962. 

5.  Chang,  S.  S.  L.,  "Optimal  Control  in  Bounded  Phase  Space,"  TR  400-37, 

College  of  Engineering,  New  York  University,  August  1961. 

6.  Breakwell,  J.  V.,  "The  Optimization  of  Trajectories,"  J.  Soc.  Indust.  Appl. 
Math.,  Vol.  7,  No.  2,  pp .  215-247,  June  1959. 

7.  Kelley,  H.  J.,  Kopp,  R.  E,  and  Moyer,  H.  G.,  "Successive  Approximation 
Techniques  for  Trajectory  Optimization,"  Proc.  of  the  IAS  Symposium  on 
Vehicle  Systems  Optimization,  1961. 

8.  Bryson,  A.  E.  and  Denham,  W.  F.,.  "A  Steepest  Ascent  Method  for  Solving 
Optimum  Programming  Problems,"  J.  Appl.  Mech.,  pp .  247-257,  June  1962. 

9.  Ho.,  Y.  C.,  "A  Successive  Approximation  Technique  for  Optimal  Control 
Systems  Subject  to  Input  Saturation,"  J.  of  Basic  Engineering,  Series  D, 
pp .  33-40,  March  1962 . 

10.  Ho.,  Y.  C.,  "A  Computational  Procedure  for  Optimal  Control  Problems  with 
State  Variable  Constraint,"  P-2402,  The  Rand  Corp.,  August  1961. 

11.  Dreyfus,  S.,  "Variational  Problems  with  Inequality  Constraints,"  J ,  of 
Math.  Anal.  Appl.,  Vol.  4,  No.  2,  pp .  297-308,  April  1962. 


55 


12.  Dreyfus,  S.,  "Variational  Problems  with  State  Variable  Inequality 
Constraints,"  P-2605,  The  Rand  Corp.,  July  1962. 

13.  Kelley,  H.  J.,  Falco,  M.  and  Ball,  D.  J.,  "Air  Vehicle  Trajectory  Opti¬ 
mization,"  presented  at  SIAM  Symposium  on  Multivariable  System  Theory, 
November,  1962 . 

14.  Leitmann,  G.,  (ed),  Optimization  Techniques,  Academic  Press,  1962. 

15.  Ho,  Y.C.  and  Brentani,  P.  B.,  "On  Computing  Optimal  Control  with  Inequality 
Constraints,"  presented  at  1962  SIAM  Symposium  on  Multivariable  System 
Theory,  November,  1962 . 

16.  Bryson,  A.  E.  and  Denham,  W.  F.,  "The  Solution  of  Optimal  Programming 
Problems  with  Inequality  Constraints,"  BR-2121,  Analytical  Research 
Department,  Raytheon  Company,  November  1962. 

17.  Stear,  E.  B.,  "A  Critical  Assessment  of  Aerospace  Vehicle  Control 

\ 

Techniques,"  (unpublished)  ASD,  Air  Force  Systems  Command,  WPAFB,  Ohio. 

18.  Kahne,  S.  J.,  "The  Method  of  Adaptive  Constrained  Descent, "  Report  R-154, 
Coordinated  Science  Laboratory,  University  of  Illinois,  October  1962. 

19.  Henri ci,  P.,  Discrete  Variable  Methods  in  Ordinary  Differential  Equations, 
Wiley  &  Sons,  New  York,  1962. 

20.  Meditch,  J.  S.  and  Neustadt,  L.  W.,  "An  Application  of  Optimal  Control  to 
Midcourse  Guidance,"  to  be  published  in  Proceedings  of  Second  Congress  of 
IFAC,  1963. 

21.  Kahne,  S.  J.,  "Note  on  Two  Point  Boundary  Value  Problems,"  IEEE  Trans,  on 
Automatic  Control,  July  1963. 

22.  Speyer,  S.  L.,  "Optimization  and  Control  Using  Perturbation  Theory  to  Find 
Neighboring  Optimum  Paths,"  BR-2142,  Analytical  Research  Dept.,  Raytheon 
Co.,  December  1962. 


I 


23.  Dreyfus,  S  .,  "The  Numerical  Solution  of  Variational  Problems,"  P-2374, 

The  Rand  Corp.,  August  1961. 

24.  Ahlberg,  J.  H.,  Clark,  J.  W.,  Williams,  J.  N.,  "Optimization  by  Direct 
Search  Methods  with  Application  to  an  Adaptive  System,"  Proc.  of  the  IAS 
Symposium  on  Vehicle  Systems  Optimization,  1961. 

25.  Bliss,  G.  A.,  Lectures  on  the  Calculus  of  Variations,  University  of 
Chicago  Press,  1946. 

26.  Berkovitz,  L.  D.,  "On  Control  Problems  with  Bounded  State  Variables," 

J.  Math.  Anal.  Appl  ■ ,  Vol.  5,  pp .  488-498,  December  1962. 

27.  Athanassiades,  J.,  et  al,  "Time  Optimal  Control  for  Plants  with  Numerator 
Dynamics,"  IRE  Transactions  on  Automatic  Control,  Vol.  AC-7,  No.  4, 

pp.  47-49,  July  1962. 

28.  Friedland.,  B.,  "Techniques  for  Computation  of  Optimum  Trajectories," 
Research  Report  63-RC-2,  General  Precision  Aerospace,  March  1963. 


APPENDIX  A 


Flow  Chart  for  Adaptive  Constrained 
Descent  Minimization  Procedure 
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ERRATA 


X.  Pg.  8 ,  Eq.  (2.1.5)  should  be: 

i(k-fA)  =  f[x(k),A]  +  B[x(k),A]  H[u(k)  ] 


;  k=l,2,...,K 


Pg.  14,  first  sentence  after  description  of  sets  should  be: 
1  *  ** 

that  U,  U  and  U  are  compact. 

Pg.  16,  Eq.  (3.2.5)  should  be: 

x(k+A)  =  f[x(k),A]  +  B[x(k),A]  H[u(k) ]  |  1 

1 


It  is  clear 


4. 

Pg. 

21, 

line  3:  - 

-  k  =  1,2, . . . . ,K-1 .  Moreover,  - 

| 

Pg. 

21, 

line  7:  - 

-  and  K~1  minor  - 

6. 

Pg. 

22, 

line  17: 

-  and  K-l  minor  - 

)  7. 

Pg. 

22, 

line  18; 

- k=l,2,  .  ... . , K- 1 . - 

8, 

1 

Pg. 

29, 

7th  line 

should  be:  control  is  guessed  to  be  u(k) 

^  9. 

Pg. 

51, 

1  i  ne  6 : 

"effect"  should  be  "effort". 

.,9. 
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I  Goodyear  Aircraft  Corporation 

For:  Project  MX  778 
Akron  15,  Ohio 

I  Battcllo-DETENDER 

Battello  Memorial  Institute 
505  King  Avonuo 
Columbus  1,  Ohio 

1  ASO  (ASMS) 

Wrlght-Pattarson  Air  Forco  Baso 
Ohio 

I  ASD  (ASRNG) 

Wrlght-Patteraon  Air  Torce  Rise 
Ohio 

1  Commanding  Offlcor  (AD-5) 

U.S.  Naval  Air  Development  Center 
Johntvllle .  Pennsylvania 
Attn;  NADC  Ubrary 

2  Commanding  OHlcor 
Trankford  Arsenal 
Philadelphia  37,  Pennsylvania 
Attn:  SMUrA*1300 


1  Goneral  Atronlcs  Corporation 
1075  DaHevon  Street 
West  COnihohocken,  Pennsylvania 
Attn;  Miss  D.  M.  Kooncr 
Ubrerian 


I  If.  E.  Cochran 

Oak  Rldgo  National  Laboratory 

P.  O.  Box  X 

Oak  Rldgo,  Tcnnossoc 

1  President 

U.S.  Army  Air  Defense  Board 
Tort  Bliss,  Toxas 

1  U.S.  Air  Force  Security  Service 

San  Antonio,  Texaa 
Attn:  ODC-R 

1  ASTfA  Technical  Uhrary  AFL  2824 

Arlington  Hall  Station 
Arlington  12,  Virginia 
Attn:  TISLL 

1  U.S.  Naval  Woapon:  laboratory 
Compulation  and  Analysts  Laboratory 
Dahlgren,  Virginia 

Attn:  Mr.  Ralph  A.  Niemann 

2  Army  Materiel  Command 
Research  Division 

R  &  D  Directorate 
Bldg.  T-7 

Gravelley  Point,  Virginia 


